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CLAIMS 

What is claimed is: 

11. A method for detecting certain objects in an image, comprising the computer- 

2 implemented steps of: 

3 placing a working window at different positions in an input image such 

4 that the input image is divided into a plurality of same dimension subwindows; 

5 providing a cascade of homogenous classification functions, each of the 

6 homogenous classification functions in sequence in the cascade respectively 

7 having increasing accuracy in identifying features associated with the certain 
^ 8 objects; and 

9 for each subwindow, employing the cascade of homogenous 

yj 10 classification functions to detect instances of the certain objects in the image. 

as « 

M3 12. The method of Claim 1 , further comprising a computer-implemented step of 

2 scaling the dimensions of the subwindows by changing a size of the 

3 working window; 

4 scaling the homogenous classification functions respectively for each 

5 different size of the working window, and 

6 for each different size of the working window, repeating the steps of 

7 placing, providing, and employing. 

1 3 . The method of Claim 1 , further comprising a computer-implemented step of 

2 computing an integral image representation of the input image; and 

3 wherein the step of employing the cascade includes utilizing the integral 

4 image representation in computing the homogenous classification functions. 



s !■■; 



1 



4. 



The method of Claim 1, wherein the certain objects are human faces. 
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1 5. The method of Claim 1, further comprising a computer-implemented step of 

2 training the homogenous classification functions in a learning phase based on a 

3 training data set and thereby identifying optimal such functions. 

1 6. The method of Claim 5, further comprising constructing the cascade based on 

2 the optimal homogenous classification functions such that the step of employing 

3 the cascade performs at an average processing rate of less than about 200 

4 arithmetic operations for each subwindow. 

1 7. The method of Claim 6, wherein the processing rate is independent of the 

2 dimensions of the subwindows. 

yj 1 8. The method Claim 1, further comprising a computer-implemented step of 

ji 2 providing to a computer output device an output image that identifies the 

\/l 3 detected instances of the certain objects based on the step of employing the 

4 cascade. 

f 7 1 9. The method of Claim 1, wherein each homogenous classification function is 

2 based on a number N of the features and a plurality of threshold functions h p 

p 3 each feature having one of the respective threshold functions /^identified 

rr * 4 respectively by an iterator j having values from 7=1 to y=N, a given threshold 

5 function h } for a given feature defined as follows: 



hj= ( 1, if pjfj(x) > pjTj 
j 0, otherwise 



7 wherein x is a vector of pixel values in a given subwindow; wherein f } is 

8 an evaluation function for the given feature; wherein T } is a predefined feature 

9 threshold for the given feature indicating a presence of the given feature in the 

10 subwindow by assigning a value of 1 to the given threshold function h p and 

1 1 wherein pj is a polarity value having a value of +1 or -1 ; and 
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12 wherein each homogeneous classification function is based on a 

1 3 summation function defined as follows: 

N 

14 Y j wjhj(x)>Q 

1 5 wherein is a predefined weight for each threshold function h p and 

16 wherein 0 is a predefined global threshold that determines whether or not the 

17 summation function indicates a detection of one of the instances of the certain 

1 8 obj ect in the given subwindow. 



1 10. The method of Claim 1 wherein the features are rectangular features. 



i3 . 1 11. An object detection system for detecting certain objects in an image, comprising: 

fjj 2 an image scanner for placing a working window at different positions in 

% i 

3 an input image such that the input image is divided into a plurality of same 

iJ 

UT 4 dimension subwindows; and 

is 

is* 5 an object detector for providing a cascade of homogenous classification 

f r 6 functions, each of the homogenous classification functions in sequence in the 

PJ 7 cascade respectively having increasing accuracy in identifying features 

y : 8 associated with the certain objects; 

9 the object detector employing, for each subwindow, the cascade of 

10 homogenous classification functions to detect instances of the certain objects in 

1 1 the image. 



1 12. The obj ect detection system of Claim 1 1 , wherein the image scanner scales the 

2 dimensions of the subwindows by changing a size of the working window; and 

3 wherein the object detector scales the homogenous classification 

4 functions respectively for each different size of the working window, and, for 

5 each different size of the working window, (i) the image scanner repeats the 

6 placing of the scaled working window at different positions in the input image to 

7 divide the input image into a plurality of scaled same dimension subwindows, 
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and (ii) the object detector repeats the employing of the cascade of scaled 
homogenous classification functions to detect the instances of the certain 
objects. 

The object detection system of Claim 11, further comprising an image integrator, 
wherein the image integrator computes an integral image representation of the 
input image; and 

wherein the object detector utilizes the integral image representation in 
computing the homogenous classification functions. 

The object detection system of Claim 1 1, wherein the certain objects are human 
faces. 

The object detection system of Claim 11, further comprising a training server, 
wherein the training server trains the homogenous classification functions in a 
learning phase based on a training data set and thereby identifying optimal such 
functions. 

The object detection system of Claim 15, wherein the training server constructs 
the cascade based on the optimal homogenous classification functions such that 
the object detector performs the employing of the cascade at an average 
processing rate of less than about 200 arithmetic operations for each subwindow. 

The object detection system of Claim 16, wherein the processing rate is 
independent of the dimensions of the subwindows. 

The object detection system Claim 11, wherein the object detector provides to a 
computer output device an output image that identifies the detected instances of 
the certain objects based on the employing of the cascade. 
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1 19. The object detection system of Claim 1 1 , wherein each homogenous 

2 classification function is based on a number N of the features and a plurality of 

3 threshold functions h 9 each feature having one of the respective threshold 

4 functions hj identified respectively by an iterator j having values from j=l to 

5 y=N, a given threshold function for a given feature defined as follows: 

hj « f 1, ifpfflx) > pjTj 

6 "i 0, otherwise 



wherein x is a vector of pixel values in a given subwindow; wherein f is 
an evaluation function for the given feature; wherein T 3 is a predefined feature 
threshold for the given feature indicating a presence of the given feature in the 
subwindow by assigning a value of 1 to the given threshold function h j9 and 
wherein pj is a polarity value having a value of +1 or -1 ; and 

wherein each homogeneous classification function is based on a 
summation function defined as follows: 

N 

^wjhj(x)>Q 

7=1 

wherein is a predefined weight for each threshold function h p and 
wherein 0 is a predefined global threshold that determines whether or not the 
summation function indicates a detection of one of the instances of the certain 
object in the given subwindow. 

1 20. The object detection system of Claim 1 1, wherein the features are rectangular 

2 features. 

1 2 L A computer program product comprising: 

2 a computer usable medium for detecting certain objects in an image; and 

3 a set of computer program instructions embodied on the computer 

4 useable medium, including instructions to: 
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5 place a working window at different positions in an input image 

6 such that the input image is divided into a plurality of same dimension 

7 subwindows; 

8 provide a cascade of homogenous classification functions, each of 

9 the homogenous classification functions in sequence in the cascade 

1 0 respectively having increasing accuracy in identifying features associated 

1 1 with the certain objects; and 

12 for each sub window, employ the cascade of homogenous 

13 classification functions to detect instances of the certain objects in the 

14 image. 



A method for detecting certain objects in an image, comprising the computer- 
implemented steps of: 

(i) dividing an input image into a plurality of subwindows, each 
subwindow having a sufficient size to allow processing of features associated 
with the certain objects; and 

(ii) processing the subwindows at an average processing rate less than 
about 200 arithmetic operations for each subwindow by: 

(a) evaluating the features in each subwindow; and 

(b) classifying each subwindow to detect an instance of the 
certain objects based on the step of evaluating the features. 

The method of Claim 22, wherein the processing rate is independent of 
dimensions of the subwindows. 

The method of Claim 22, further comprising a computer-implemented step of 
computing an integral image representation of the input image and using the 
integral image representation to compute homogenous classification functions 
for use in the step of processing the subwindows. 
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1 25. The method of Claim 22, wherein the step of processing the subwindows 

2 comprises: 

3 for each subwindow, employing a cascade of optimal homogenous 

4 classification functions, each optimal homogenous classification function in 

5 sequence in the cascade respectively having increasing accuracy in identifying 

6 the features associated with the certain objects; and, 

7 at each optimal homogenous classification function in the cascade: 

8 if a subj ect subwindow has the detected instance of the certain 

9 object, continuing to pass the subject subwindow through the cascade for 

1 0 further processing, and 

1 1 if the subject subwindow does not have the detected instance of 

12 the certain object, ceasing to pass the subject subwindow through the 

13 cascade. 

1 26. The method of Claim 22, wherein the certain objects are human faces. 

1 27. An object detection system for detecting certain objects in an image, comprising: 

2 (i) an image scanner for dividing an input image into a plurality of 

3 subwindows, each subwindow having a sufficient size to allow processing of 

4 features associated with the certain objects; and 

5 (ii) an object detector for processing the subwindows at an average 

6 processing rate less than about 200 arithmetic operations for each subwindow 

7 by: 

8 (a) evaluating the features in each subwindow; and 

9 (b) classifying each subwindow to detect an instance of the 

10 certain objects based on the step of evaluating the features. 



1 

2 



28. The object detection system of Claim 27, wherein the processing rate is 
independent of dimensions of the subwindows. 
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1 29. The obj ect detection system of Claim 27, further comprising an image integrator, 



2 wherein the image integrator computes an integral image representation 

3 of the input image; and 

4 the object detector uses the integral image representation to compute 

5 homogenous classification functions for use in the processing of the 

6 subwindows. 



The object detection system of Claim 27, wherein: 

the object detector, for each subwindow, employs a cascade of optimal 
homogenous classification functions, each optimal homogenous classification 
function in sequence in the cascade respectively having increasing accuracy in 
identifying the features associated with the certain objects; and, 

at each optimal homogenous classification function in the cascade, the 
object detector: 

if a subject subwindow has the detected instance of the certain 
object, continues to pass the subject subwindow through the cascade for 
further processing, and 

if the subject subwindow does not have the detected instance of 
the certain object, ceases to pass the subject subwindow through the 
cascade. 



1 31. The obj ect detection system of Claim 27, wherein the certain obj ects are human 

2 faces. 

1 32. A computer program product comprising: 

2 a computer usable medium for detecting certain objects in an image; and 

3 a set of computer program instructions embodied on the computer 

4 useable medium, including instructions to: 

5 (i) divide an input image into a plurality of subwindows, each 

6 subwindow having a sufficient size to allow processing of features 
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7 associated with the certain objects; and 

8 (ii) process the subwindows at an average processing rate less 

9 than about 200 arithmetic operations for each subwindow by: 

1 0 (a) evaluating the features in each subwindow; and 

1 1 (b) classifying each subwindow to detect an instance of 

12 the certain objects based on the step of evaluating the features. 



